Automatic Generation of Coherent Image Galleries in Virtual Reality

With the rapidly increasing size of digitized and born-digital multimedia collections in archives, museums and private collections, manually curating collections becomes a nearly impossible task without disregarding large parts of the collection. In this paper, we propose the use of Self-Organizing Maps (SOMs) to automatically generate coherent image galleries that allow intuitive, user-driven exploration of large multimedia collections in virtual reality (VR). We extend the open-source VR museum VIRTUE to support such exhibitions and apply it on different collections using various image features. A successful pilot test took place at the Basel Historical Museum with more than 300 participants

Process-Based Design and Integration of Wireless Sensor Network Applications

Abstract Wireless Sensor and Actuator Networks (WSNs) are distributed sensor and actuator networks that monitor and control real-world phenomena, enabling the integration of the physical with the virtual world. They are used in domains like building automation, control systems, remote healthcare, etc., which are all highly process-driven. Today, tools and insights of Business Process Modeling (BPM) are not used to model WSN logic, as BPM focuses mostly on the coordination of people and IT systems and neglects the integration of embedded IT. WSN development still requires significant special-purpose, low-level, and manual coding of process logic. By exploiting similarities between WSN applications and business processes, this work aims to create a holistic system enabling the modeling and execution of executable processes that integrate, coordinate, and control WSNs. Concretely, we present a WSNspecific extension for Business Process Modeling Notation (BPMN) and a compiler that transforms the extended BPMN models into WSN-specific code to distribute process execution over both a WSN and a standard business process engine. The developed tool-chain allows modeling of an independent control loop for the WSN.

Competitive Interactive Video Retrieval in Virtual Reality with vitrivr-VR

Virtual Reality (VR) has emerged and developed as a new modality to interact with multimedia data. In this paper, we present vitrivr-vr, a prototype of an interactive multimedia retrieval system in VR based on the open source full-stack multimedia retrieval system vitrivr. We have implemented query formulation tailored to VR: Users can use speech-to-text to search collections via text for concepts, OCR and ASR data as well as entire scene descriptions through a video-text co-embedding feature that embeds sentences and video sequences into the same feature space. Result presentation and relevance feedback in vitrivr-VR leverages the capabilities of virtual spaces

Towards Explainable Interactive Multi-Modal Video Retrieval with vitrivr

This paper presents the most recent iteration of the vitrivr multimedia retrieval system for its participation in the Video Browser Showdown (VBS) 2021. Building on existing functionality for interactive multi-modal retrieval, we overhaul query formulation and results presentation for queries which specify temporal context, extend our database with index structures for similarity search and present experimental functionality aimed at improving the explainability of results with the objective of better supporting users in the selection of results and the provision of relevance feedback

Exploring Intuitive Lifelog Retrieval and Interaction Modes in Virtual Reality with vitrivr-VR

The multimodal nature of lifelog data collections poses unique challenges for multimedia management and retrieval systems. The Lifelog Search Challenge (LSC) offers an annual evaluation platform for such interactive retrieval systems. They compete against one another in finding items of interest within a set time frame. In this paper, we present the multimedia retrieval system vitrivr-vr, the latest addition to the vitrivr stack, which participated in the LSC in recent years. vitrivr-vr leverages the 3D space in virtual reality (VR) to offer novel retrieval and user interaction models, which we describe with a special focus on design decisions taken for the participation in the LSC

Demo Abstract: From Business Process Specifications to Sensor Network Deployments

makeSenseCONE

Towards Business Processes Orchestrating the Physical Enterprise with Wireless Sensor Networks

The industrial adoption of wireless sensor net- works (WSNs) is hampered by two main factors. First, there is a lack of integration of WSNs with business process modeling languages and back-ends. Second, programming WSNs is still challenging as it is mainly performed at the operating system level. To this end, we provide makeSense: a unified programming framework and a compilation chain that, from high-level business process specifications, generates code ready for deployment on WSN nodes

How recombinant swollenin from Kluyveromyces lactis affects cellulosic substrates and accelerates their hydrolysis

<p>Abstract</p> <p>Background</p> <p>In order to generate biofuels, insoluble cellulosic substrates are pretreated and subsequently hydrolyzed with cellulases. One way to pretreat cellulose in a safe and environmentally friendly manner is to apply, under mild conditions, non-hydrolyzing proteins such as swollenin - naturally produced in low yields by the fungus <it>Trichoderma reesei</it>. To yield sufficient swollenin for industrial applications, the first aim of this study is to present a new way of producing recombinant swollenin. The main objective is to show how swollenin quantitatively affects relevant physical properties of cellulosic substrates and how it affects subsequent hydrolysis.</p> <p>Results</p> <p>After expression in the yeast <it>Kluyveromyces lactis</it>, the resulting swollenin was purified. The adsorption parameters of the recombinant swollenin onto cellulose were quantified for the first time and were comparable to those of individual cellulases from <it>T. reesei</it>. Four different insoluble cellulosic substrates were then pretreated with swollenin. At first, it could be qualitatively shown by macroscopic evaluation and microscopy that swollenin caused deagglomeration of bigger cellulose agglomerates as well as dispersion of cellulose microfibrils (amorphogenesis). Afterwards, the effects of swollenin on cellulose particle size, maximum cellulase adsorption and cellulose crystallinity were quantified. The pretreatment with swollenin resulted in a significant decrease in particle size of the cellulosic substrates as well as in their crystallinity, thereby substantially increasing maximum cellulase adsorption onto these substrates. Subsequently, the pretreated cellulosic substrates were hydrolyzed with cellulases. Here, pretreatment of cellulosic substrates with swollenin, even in non-saturating concentrations, significantly accelerated the hydrolysis. By correlating particle size and crystallinity of the cellulosic substrates with initial hydrolysis rates, it could be shown that the swollenin-induced reduction in particle size and crystallinity resulted in high cellulose hydrolysis rates.</p> <p>Conclusions</p> <p>Recombinant swollenin can be easily produced with the robust yeast <it>K. lactis</it>. Moreover, swollenin induces deagglomeration of cellulose agglomerates as well as amorphogenesis (decrystallization). For the first time, this study quantifies and elucidates in detail how swollenin affects different cellulosic substrates and their hydrolysis.</p

Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS

This paper presents findings of the eleventh Video Browser Showdown competition, where sixteen teams competed in known-item and ad-hoc search tasks. Many of the teams utilized state-of-the-art video retrieval approaches that demonstrated high effectiveness in challenging search scenarios. In this paper, a broad survey of all utilized approaches is presented in connection with an analysis of the performance of participating teams. Specifically, both high-level performance indicators are presented with overall statistics as well as in-depth analysis of the performance of selected tools implementing result set logging. The analysis reveals evidence that the CLIP model represents a versatile tool for cross-modal video retrieval when combined with interactive search capabilities. Furthermore, the analysis investigates the effect of different users and text query properties on the performance in search tasks. Last but not least, lessons learned from search task preparation are presented, and a new direction for ad-hoc search based tasks at Video Browser Showdown is introduced